Big Data Analytics for Earth Sciences: the EarthServer approach

Big Data Analytics is an emerging field since massive storage and computing capabilities have been made available by advanced e-infrastructures. Earth and Environmental sciences are likely to benefit from Big Data Analytics techniques supporting the processing of the large number of Earth Observation datasets currently acquired and generated through observations and simulations. However, Earth Science data and applications present specificities in terms of relevance of the geospatial information, wide heterogeneity of data models and formats, and complexity of processing. Therefore, Big Earth Data Analytics requires specifically tailored techniques and tools. The EarthServer Big Earth Data Analytics engine offers a solution for coverage-type datasets, built around a high performance array database technology, and the adoption and enhancement of standards for service interaction (OGC WCS and WCPS). The EarthServer solution, led by the collection of requirements from scientific communities and international initiatives, provides a holistic approach that ranges from query languages and scalability up to mobile access and visualization. The result is demonstrated and validated through the development of lighthouse applications in the Marine, Geology, Atmospheric, Planetary and Cryospheric science domains.

Big Data Analytics for Earth Sciences: the EarthServer approach

Big Data Analytics is an emerging field since massive storage and computing capabilities have been made available by advanced e-infrastructures. Earth and Environmental sciences are likely to benefit from Big Data Analytics techniques supporting the processing of the large number of Earth Observation datasets currently acquired and generated through observations and simulations. However, Earth Science data and applications present specificities in terms of relevance of the geospatial information, wide heterogeneity of data models and formats, and complexity of processing. Therefore, Big Earth Data Analytics requires specifically tailored techniques and tools. The EarthServer Big Earth Data Analytics engine offers a solution for coverage-type datasets, built around a high performance array database technology, and the adoption and enhancement of standards for service interaction (OGC WCS and WCPS). The EarthServer solution, led by the collection of requirements from scientific communities and international initiatives, provides a holistic approach that ranges from query languages and scalability up to mobile access and visualization. The result is demonstrated and validated through the development of lighthouse applications in the Marine, Geology, Atmospheric, Planetary and Cryospheric science domains.

Mighty small: Observing and modeling individual microbes becomes big science

Progress in microbiology has always been driven by technological advances, ever since Antonie van Leeuwenhoek discovered bacteria by making an improved compound microscope. However, until very recently we have not been able to identify microbes and record their mostly invisible activities, such as nutrient consumption or toxin production on the level of the single cell, not even in the laboratory. This is now changing with the rapid rise of exciting new technologies for single-cell microbiology (1, 2), which enable microbiologists to do what plant and animal ecologists have been doing for a long time: observe who does what, when, where, and next to whom. Single cells taken from the environment can be identified and even their genomes sequenced. Ex situ, their size, elemental, and biochemical composition, as well as other characteristics can be measured with high-throughput and cells sorted accordingly. Even better, individual microbes can be observed in situ with a range of novel microscopic and spectroscopic methods, enabling localization, identification, or functional characterization of cells in a natural sample, combined with detecting uptake of labeled compounds. Alternatively, they can be placed into fabricated microfluidic environments, where they can be positioned, exposed to stimuli, monitored, and their interactions controlled “in microfluido.” By introducing genetically engineered reporter cells into a fabricated landscape or a microcosm taken from nature, their reproductive success or activity can be followed, or their sensing of their local environment recorded.